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METHOD AND DEVICE FOR EFFICIENT BANDWIDTH MANAGEMENT 

Field of the Invention 

The present invention relates generally to bandwidth management, and more 
particularly to dynamic, real-time bandwidth management of traffic in Internet Protocol 
networks. 

Background of the Invention 

Today's Internet Protocol (IP) networks mostly work as one-class, best-effort 
networks. As these networks evolve to Quality of Service (QoS)-enabled, multi-class, 
application-aware networks, bandwidth management will be one of the crucial resource 
management mechanisms to insure each application a fair share of bandwidth, especially 
at congestion points. There are several products, called bandwidth managers or packet 
shapers, that offer such a mechanism at the access points to or from the Wide Area 
Network (WAN). In particular, one such scheme, Class Based Queuing (CBQ), has 
gained significant popularity after being implemented in real bandwidth management 
products such as Xedia's Access Point® to guarantee bandwidth for applications and 
provide Quality of Service differentiation. Products offering CBQ are widely available 
and are being deployed in the field to guarantee bandwidth for real-time and other 
business-critical applications (e.g., voice, e-transactions). However, a challenging 
problem in putting these products into practical use is the need to configure them in a 
way that will match the needs of the particular site and links, whose bandwidth is 
allocated. There is a need for a method and device that dynamically provide real-time 
allocation of bandwidth for real-time and non-real-time applications based on 
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measurements, thus enabling the use of bandwidth managers without the administrative 
burden of manual configuration and update. 

Summary of the Invention 

The present invention provides a method for dynamically managing allocation of 
bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for Class Based 
Queuing (CBQ). The method includes the steps of maintaining a minimized reserved 
portion of bandwidth to minimize delay jitter and maximizing a shared portion of 
bandwidth to maximize overall bandwidth utilization. Allocation of bandwidth may be 
based on a hierarchical-tree sharing scheme that provides for temporary borrowing of 
bandwidth by real-time or critical applications from bandwidth of non-real-time or non- 
critical applications and prevents borrowing of bandwidth by non-real-time or non- 
critical applications from bandwidth of real-time or critical applications. The DSS 
provides for using measurable parameters, such as queue length or number of borrowing 
attempts per a predetermined length of time, as control triggers for implementing 
adjustment of bandwidth allocation. 

The present invention may also provide for dynamically managing allocation of 
bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for Class Based 
Queuing (CBQ) using the steps of measuring a predetermined parameter at 
predetermined observation window times and dynamically adjusting allocated bandwidth 
for parent classes of real-time or critical traffic by adjusting an average of the 
predetermined parameter to have a value within a predetermined stable region. Again, 
dynamically adjusting allocated bandwidth, such as the DDS method of the present 
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invention, may be based on a sharing tree hierarchical scheme that provides for 
temporary borrowing of bandwidth by real-time or critical applications from bandwidth 
of non-real-time or non-critical applications and blocks borrowing of bandwidth by non- 
real-time or non-critical applications from bandwidth of real-time or critical applications. 
The predetermined parameter measured may, for example, be queue length or number of 
borrowing attempts during a predetermined measurement window. Where the 
predetermined parameter is a number of borrowing attempts during a measurement 
window, a maximum bandwidth and a minimum bandwidth for the predetermined stable 
region may be determined by the following algorithm, where the subscript i stands for 
class i: 

IfAi avg < ThrfAJ 10 ™ Bi = maximum^ - eof™ , Min(B t )) 

Else IfA i avg > Thr(A i ) upper ) Bi = minimum(Bi + co? p , Max(B$) 

where Ai is a number of borrowing attempts by class i during a most recent 
measurement window and 

Ai avg is an average number of borrowing attempts/controlled state; 

upper and lower thresholds for the predetermined stable region are preset at 
predetermined values: 

Thr(A$°™ r is a lower threshold for borrowing attempts, where Thr(k$°™ r > 0; 
ThrfAJT^is a upper threshold for borrowing attempts, where Thr(A\) upper > Thr(K^° wer ; 

the increment and decrement units (of oym and co" p , which denote the update granularity 
on allocated bandwidth B u are preset at predetermined values; 
MaxfBj) is a maximum value of allocated bandwidth; 
Min(B t ) is a minimum value of allocated bandwidth; and 
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exponential smoothing technique is used as follows, 



<-(l-a)*A Lmg + a*A i9 



where a value of a is preselected as a negative power of two and A i aV g is updated every 
observation window, a pre-determined parameter in seconds. 
Where the predetermined parameter is a queue length, a lower threshold and an 
upper threshold for queue length for the predetermined stable region may be determined 



VQij»g < Thr(Q? 0 ™\ Bi = maximumfBi - ca l} Min(B x )) 
Else IfQ^ > Thr(Qi) upper , Bi = minimum(Bi + 6>, , Max(B t )\ 
Qi is an instantaneous measurement of queue length; 

Q i avg is a calculated average value for an average queue length; 

upper and lower thresholds are preset at predetermined values: 

ThrfQ^ is a lower threshold for queue length, where Thr(Qj) lower > 0; and 

Thr(Qi) upper is an upper threshold for queue length where Thr(QJ upper > 



The queue size for class /, which is also the upper bound for the queue length Q t , is related to an 
upper bound on the delay jitter as: 



Hence, if a jitter upper bound Delay Jitter J is preselected, then a linear relationship exists 
between maxQ, and 5, , the allocated bandwidth. 

The present invention may also be implemented by a computer-readable medium 
having computer-executable instructions for dynamically managing allocation of 



by: 



Thr(Qi) 



.lower 



Delay Jitter J = maxQ, /B t 
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bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for Class Based 
Queuing (CBQ). The computer-executable instructions may include measuring a 
predetermined parameter at predetermined observation window times and dynamically 
adjusting allocated bandwidth for parent classes of real-time or critical traffic by 
adjusting an average of the predetermined parameter to have a value within a 
predetermined stable region. 

The present invention may be implemented by a device that includes a parameter 
measuring unit and a bandwidth sharing determining unit. The parameter measuring unit 
is coupled to the bandwidth sharing determining unit and is used for (i) measuring a 
predetermined parameter at predetermined observation window times, and (ii) 
dynamically adjusting allocated bandwidth for parent classes of real-time or critical 
traffic by adjusting an average of the predetermined parameter to have a value within a 
predetermined stable region. The DSS generally provides for using measurable 
parameters such as queue length or number of borrowing attempts per a predetermined 
length of time or predetermined measurement window as control triggers for 
implementing adjustment of bandwidth allocation. Where the predetermined parameter 
is a number of borrowing attempts during a measurement window of the DDS method, a 
maximum bandwidth and a minimum bandwidth for the predetermined stable region may 
be determined as described above. Where the predetermined parameter is a queue length 
of the DDS method, a lower threshold and an upper threshold for queue length for the 
predetermined stable region may be determined as described above. 
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Brief Description of the Drawings 



The foregoing summary of the invention, as well as the following detailed 
description of preferred embodiments, is better understood when read in conjunction with 
the accompanying drawings, which are included by way of example, and not by way of 
limitation with regard to the claimed invention. 

Figure 1 is a schematic representation of a sharing tree hierarchy with three 
control states generated using limits and thresholds in accordance with the present 
invention. 

Figure 2 is a flow chart showing steps for one embodiment of a method for 
dynamically managing allocation of bandwidth in a packet network using a Dynamic 
Setting Scheme (DSS) for Class Based Queuing (CBQ) in accordance with the present 
invention. 

Figure 3 is a flow chart and block diagram showing another embodiment of steps 
of a method and of a computer-readable medium for dynamically managing allocation of 
bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for Class Based 
Queuing (CBQ) in accordance with the present invention. 

Figure 4 is a block diagram showing one embodiment of a device for dynamically 
managing allocation of bandwidth in a packet network using a Dynamic Setting Scheme 
(DSS) for Class Based Queuing (CBQ) in accordance with the present invention. 

Detailed Description of the Preferred Embodiments 

In previous implementations, classes with heavy-volume traffic tended to 
dominate the bandwidth for a relatively long period of time and cause a high delay jitter 
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for classes with light traffic volume even if the latter were allocated sufficient bandwidth. 
Since the traffic volume of some real-time applications, e.g., voice, is relatively low and 
the bandwidth consumption of such applications is more predictable, it is desirable to 
separate these applications from the rest of the traffic, which includes many data 
applications with unpredictable volume and bursty bandwidth consumption. However, 
while total separation provides security, it also reduces the total utilization of bandwidth. 
One alternative is to allow voice traffic to borrow bandwidth from data traffic, but not 
allow data to borrow from voice. In this situation, one wants to reserve sufficient 
bandwidth for voice and, at the same time, avoid over-engineering in order to increase the 
bandwidth utilization. 

Due to the fact that traffic conditions are dynamic and somewhat unpredictable, it 
is not possible to find a value for bandwidth allocation that satisfies the desired objectives 
in all circumstances. The present invention implements a bandwidth sharing hierarchy 
and a dynamic scheme for setting bandwidth management parameters. Since Internet 
Protocol (IP) technology is implemented in various access methods, i.e., Cable Plant, 
fixed wireless, and DSL, and also in the backbone, the present invention has far-reaching 
applicability in the present and future networks. The present invention provides 
capabilities for more efficient use of bandwidth and the ability to use the same network 
for both voice and data applications. Moreover, the present invention provides for 
integrating voice traffic and data traffic and provides mechanisms for allocation of 
bandwidth to priority data or voice-over-IP (VOIP) services that ensure that valuable 
corporate resources are available to critical business applications. 
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For example, where bandwidth is allocated according to application delay 
requirements, assume that there are two types of traffic: real-time and non-real-time 
traffic. There are a predetermined number n of classes, and each type of traffic may have 
one or more leaf classes: ci through Ck are classes of real-time or other critical 
applications, while the remaining classes cr-h through Cn include non-critical applications. 
The objectives are twofold: 

1. Minimize the delay jitter for real-time applications by reserving sufficient 
bandwidth. 

2. Maximize the overall bandwidth utilization by allowing bandwidth sharing across 
non- real-time applications. 

The above goals are achieved by setting a borrowing permit according to the 
traffic's delay requirement, i.e., only allowing real-time applications to borrow from non- 
real-time, but not vice versa. As a result, one needs an extra level in the sharing tree 
hierarchy as is shown in Figure 1 . If Ci exceeds its allocated bandwidth, it can temporarily 
borrow from all its parent classes, i.e., RT 104 and Root 102. On the other hand, if C(k+i) 
exceeds its allocation, it can only borrow from NON-RT 106. Such a sharing hierarchy 
includes reservation and sharing strategies. However, due to the traffic dynamics, a static 
allocation that meets the performance objectives in all circumstances has not been 
available. To guarantee real-time application delay requirements, one needs to allocate 
sufficient bandwidth to such applications. On the other hand, to maximize the bandwidth 
utilization, one must maintain the reserved portion of bandwidth as small as possible and 
maximize the shared portion. 
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For a better tradeoff between guaranteeing delay and maximizing the utilization, 
the present invention provides a dynamic scheme that adapts to traffic variations. The 
present invention utilizes a scheme that is simple enough to be readily implemented - a 
dynamic setting scheme (DSS) for CBQ. The fundamental concept embedded in DSS is 
the use of measurable parameters as control triggers. The measurable parameters may be 
related to performance objectives. For example, queue length may be directly related to 
delay and delay jitter, which are the main performance measures for real-time traffic. 
Moreover, borrowing attempts may be used to indicate whether the allocated bandwidth 
is sufficient. Both queue length and borrowing attempts are easily measured and therefore 
may be used as control triggers in a DSS scheme. However, other measurable parameters 
can be used as control triggers in the DSS scheme. 

Two examples of DSS are described below wherein queue length and borrowing 
attempts are used as control triggers. In the first example, where DSS is triggered by 
borrowing attempts, let A* be the number of borrowing attempts initiated by class i during 
an observation window. An "observation window" is a time interval during which the Aj 
is measured. The objective of DSS is to dynamically adjust the allocated bandwidth for 
parent classes of real-time or critical traffic according to the number of borrowing 
attempts made by these classes during the most recent observation window. Since the 
traffic characteristics are unknown and changing, it is impossible to find an optimal Ai 
that suits all circumstances. However, by keeping the above state variable within a 
desired region and allowing a certain degree of fluctuation within the desired region, the 
performance is kept at a satisfactory level. Therefore, two levels of thresholds are used 
for A; ( the desired region being designated as the "stable region". The performance is 



9 



2000-0048 




measured in terms of the delay and delay jitter of real-time classes and the utilization of 
the root class (which accounts for the total traffic). 

The DSS scheme uses the average number of borrowing attempts, Ai_ avg , to trigger 
the control actions. The status of the state variable is checked on a periodic basis. If the 
state variable is in the stable region, no action needs to be taken. If the state variable is 
outside the stable region, the allocated bandwidth Bi for the real-time class is updated, 
moving Ai_ a v g back into the stable region. As is known in the art, an exponential 
smoothing technique is used to calculate the average number of borrowing attempts. Such 
a smoothing technique avoids too much oscillation due to the effect of overreacting to the 
system's instantaneous fluctuations. The implication is that as long as the smoothed 
average values stay inside the stable region, certain incidences are permitted wherein the 
actual values of the state variable are outside the stable region, either higher than the 
upper threshold or lower than the lower threshold. 

The parameters used in the algorithm are defined as follows. The first set of 
parameters includes the instantaneous measurement on the state variable and its 
calculated average value: 

• A4: the number of borrowing attempts during the last measurement window; and 

• Ai_av g : the average borrowing attempts. 

The following set of parameters consists of the upper and lower thresholds on the above 
state variable which are preset at predetermined desired values: 

• Thr(Ai) Iower : the lower threshold for borrowing attempts, e.g. Thr(Ai) lower =2. One 
should note that Thr(Ai) lower cannot be set to zero. 
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• Thr(Ai) upper : the upper threshold for borrowing attempts, e.g. Thr(Ai) upper =10. 

The next parameter is the increment or decrement unit on the allocated bandwidth B; 
preset at a predetermined value (where i stands for class i): 

• (Di down : the downward update granularity for allocated bandwidth B;; 

• 6)j up : the upward update granularity for allocated bandwidth B;; 

The last two parameters are the upper and lower limits on the allocated bandwidth that 
are typically selected according to applications being used: 

• Max(Bj): maximum value of allocated bandwidth; 

• Min(B;): minimum value of allocated bandwidth. 

The average state variables may be obtained using the exponential smoothing technique 
as follows: 

Aj_ a vg ^ (l"C0*A4_avg , 

where the value of a is chosen as a (negative) power of two, i.e., 2" n , n=0, 1, 2, which 
may be implemented with one shift and two additions. Ai_ avg is updated every observation 
window, generally a pre-determined parameter in seconds. 

Using the limits and the thresholds, three states are generated for control 
purposes, as is shown in Figure 3. Ai_ avg represents a controlled state. As long as the 
controlled state is outside the stable region, the value of allocated bandwidth B; will be 
updated to move the controlled state back to the stable region. Hence, the algorithm for 
DSS (306) is as follows: 

If Ai avg < Thr(Ai) Iower , B; = maximum(Bi - tof™ Min(B;)) 

Else If A L avg > Thr(Ai) upper , Bi = minimum(Bi + o>/*, Max(B;)) 
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In the second example, where DSS is triggered by queue length, queue length is 
used to trigger the DSS so as to control the delay jitter since delay jitter is one of the main 
performance measures in voice-over-IP applications. Queue length is selected as a 
control trigger because voice traffic needs to be given strict high priority while traversing 
the network. Thus, generally voice traffic will not encounter excessive queuing delay 
inside the network, and, for a given path, the propagation delay is fixed. Hence, the only 
source for delay jitter for voice traffic will be at the ingress queue. Moreover, where 
bandwidth is reserved for voice traffic at the bandwidth manager, the queue length Q; for 
class i may be related to the upper bound of delay jitter as: 

DelayJitter_i = Qi/Bi 

such that, where the desired jitter upper bound Delay Jitter i is given, then a linear 
relationship exists between Q; and Bi (allocated bandwidth) (308). 

The parameters used in the second example are defined as follows. The first set of 
parameters includes the instantaneous measurement on the state variable and its 
calculated average value: 

• Q;: the queue length; 

• Q i_av g : the average queue length. 

The following set of parameters consists of the upper and lower thresholds on the above 
state variable which are preset at predetermined values: 

• Thr(Qi) lower : the lower threshold for queue length, e.g., Thr(Qi) lower =2. One should 
note that Thr(Qi) lower cannot be set to zero. 
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• Thr(Qi) upper : the upper threshold for queue length, e.g. Thr(Qj) upper =10. 
As is clear from the explanation above, replacing Ai_ avg of the above DSS algorithm by 
Qi avg yields a DSS triggered by queue length. 

Thus, as shown in Figure 2, the present invention may be implemented as a 
method for dynamically managing allocation of bandwidth in a packet network using a 
Dynamic Setting Scheme (DSS) for Class Based Queuing (CBQ). The steps of the 
method include: maintaining (202) a minimized reserved portion of bandwidth to 
minimize delay jitter and maximizing (204) a shared portion of bandwidth to maximize 
overall bandwidth utilization. Allocation of bandwidth may be based on a sharing tree 
hierarchical scheme that provides for temporary borrowing of bandwidth by real-time or 
critical applications from bandwidth of non-real-time or non-critical applications and 
blocks borrowing of bandwidth by non-real-time or non-critical applications from 
bandwidth of real-time or critical applications. The DSS may provide for using 
measurable parameters such as queue length or number of borrowing attempts per a 
predetermined length of time as control triggers for implementing adjustment of 
bandwidth allocation. 

In another embodiment, as shown in Figure 3, the method of the present invention 
provides for dynamically managing allocation of bandwidth in a packet network using a 
Dynamic Setting Scheme (DSS) for Class Based Queuing (CBQ), by utilizing the steps 
of: measuring (302) a predetermined parameter at predetermined observation window 
times and 

dynamically adjusting (304) allocated bandwidth for parent classes of real-time or critical 
traffic by adjusting an average of the predetermined parameter to have a value within a 
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predetermined stable region. Where the predetermined parameter is a number of 



borrowing attempts during a measurement window, a maximum bandwidth and a 



minimum bandwidth for the predetermined stable region may be determined (306) by: 



IfA i avg < ThrfAJ*™", Bi = maximum^ - go?™ ,Min(B t )) 



Else IfA Lavg > Thr(A) um \ 5, = minimumfBi + eo t up , MaxfB,)) 



Where Ai is a number of borrowing attempts during a most recent 
measurement window and 

A i aV g is an average number of borrowing attempts/controlled state; 

upper and lower thresholds for the predetermined stable region are preset 
at predetermined values: 

Thr(Ai) hwer is a lower threshold, for borrowing attempts, where 



Thr(Aj) upper is a upper threshold for borrowing attempts, where 



increment and decrement units (Of own and <o? p , which denote the update 
granularity on allocated bandwidth B u are preset at predetermined values; 
MaxfBj) is a maximum value of allocated bandwidth; 

Min(B t ) is a minimum value of allocated bandwidth; and 
exponential smoothing technique is used as follows, 

Ai_avg <~ (l-a)*A i avg + a*Ai , 

where a value of a is preselected as a negative power of two and A i avg is 
updated every observation window, a pre-determined parameter in 
seconds. 



Thr(AJ lower >0; 



Thr(Ai) upper > ThrfAJ 1 



dower. 
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Where the predetermined parameter is a queue length, a lower threshold and an upper 
threshold for queue length for the predetermined stable region may be determined (308) 
by: 

I/Ql«* < ThrfQi) 10 ™ Bi = maximum^ - o)f own 9 Afrnfa)) 

Else IfQ Lavg > Thr(Qi) upper , Bi = minimum(Bi + <y/* Max(B,)l 

Qi is an instantaneous measurement of queue length; 

Q is a calculated average value for an average queue length; 

upper and lower thresholds are preset at predetermined values: 

Thr(Q i ) lower is a lower threshold for queue length, where ThrfQ^ > 0; and 

Thr(ty upper is an upper threshold for queue length where Thr(Qi) upper > 

Thr(Q i ) hwer . 

A queue size for class i, which is also an upper bound for a queue length Q f , is related to an upper 
bound on a delay jitter as: 

Delay Jitter J = maxQi/Bi 

Hence, if a jitter upper bound Delay Jitter i is preselected, then a linear relationship exists 
between maxg, and Bi , the allocated bandwidth. 

In one embodiment, as shown in Figure 3, a computer-readable medium 310 
having computer-executable instructions may be utilized for dynamically managing 
allocation of bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for 
Class Based Queuing (CBQ), wherein the computer-executable instructions comprise the 
steps of: measuring (302) a predetermined parameter at predetermined observation 
window times and dynamically adjusting (304) allocated bandwidth for parent classes of 
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real-time or critical traffic by adjusting an average of the predetermined parameter to 
have a value within a predetermined stable region. The steps of the computer-executable 
instructions may also be implemented as described above for the method. 

Figure 4 is a block diagram showing one embodiment of a device (406) for 
dynamically managing allocation of bandwidth in a packet network using a Dynamic 
Setting Scheme (DSS) for Class Based Queuing (CBQ). The device (406) typically 
includes a parameter measuring unit (402) and a bandwidth sharing determining unit 
(404). The parameter measuring unit (402) is coupled to a bandwidth sharing 
determining unit (404), and measures a predetermined parameter at predetermined 
observation window times. The bandwidth sharing determining unit (404) is coupled to 
the parameter measuring unit (402), and dynamically adjusts allocated bandwidth for 
parent classes of real-time or critical traffic by adjusting an average of the predetermined 
parameter to have a value within a predetermined stable region. Typically, the DSS 
provides for using measurable parameters such as queue length or number of borrowing 
attempts per a predetermined length of time or window of time as control triggers for 
implementing adjustment of bandwidth allocation. Where the predetermined parameter 
is a number of borrowing attempts during a measurement window, a maximum 
bandwidth and a minimum bandwidth for the predetermined stable region may be 
determined by: 

IMi.avg < Thr(A$°™\ Bi = maximum(Bi - eof own ,Min(Bi)) 
ElseIfA i avg > Thr(Ai) upper , Bi = minimum(Bi + ctf p 9 Max(B>>) 
as described more fully above. Where the predetermined parameter is a queue length, and 

a lower threshold and an upper threshold for queue length for the predetermined stable 

region may be determined by: 
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IfQi.e* < ThrfQr™, Bi = maximumfBi - co? 3 ™ ,Mm(B t )) 
Else IfQ Lw g > Thr(Qf mr , B, = minimumfBi + <o? p t Max(B$), 
as described more fully above. The dynamically adjusted allocated bandwidth for real- 
time or critical applications and non-real-time or non-critical applications is sent by the 
bandwidth sharing determining unit (404) to a bandwidth manager or traffic shaper (408), 
which then sends information on the real-time or critical applications and non-real-time 
or non-critical applications seeking to use the bandwidth to the parameter measuring unit 
(402). 

Although the present invention has been described in relation to particular 
preferred embodiments thereof, many variations, equivalents, modifications and other 
uses will become apparent to those skilled in the art. It is preferred, therefore, that the 
present invention be limited not by the specific disclosure herein, but only by the 
appended claims. 

What is claimed is: 
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